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BACKGROUND OF THE TNVENTTON 

Field of the Invention 

The present invention relates to a method and system for operation of a resihent closed 
communication network without a dedicated protection network segment. The invention uses a 
5 plurality of devices and software to provide a resilient closed communication network. 
Discussion of the Related Art 

New transmission technologies and a wide-scale deployment of WDM (Wavelength 
Division Multiplexing) system carrying many independent traffic channels over the same fiber 
have resulted in a dramatic increase in traffic capacities of fiber optic network systems. For 
10 example, transmission links up to bit rates of 10 Gbps are in commercial service and new 
developments in multi-wavelength component technologies are resulting in increased 
commercial availability of 4-, 8-, 16-, 32-, and 40 channel WDM links. 

Fiber optic network systems have been used widely in the area of communications. Their 
applications include: (1) a long-haul telecommunication systems on land and at see, such as 
15 ocean-spanning submarine cables and national backbone networks, to carry digitized signals 
simultaneously over a long distance; (2) interoffice trunks that carry many telephone 
conversations simultaneously between local and regional telephone switching faciUties; (3) 
connections to Intemet service providers; and (4) local-area networks. 

Fiber optic network systems are vulnerable to a failure due to a breaking of an optical 
20 fiber. For example, fibers can be accidentally cut by operators not aware of their presence. 
Aerial cables are broken by falling branches and errant cranes. Submarine cables are cut by 
fishermen engaged in deep-sea fishing activities or by anchors. 
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Because the amoiint of information exchanged in a fiber optic network system is very 
high, a failure can have severe consequences in that a very high number of network users can be 
deprived of an information flow. In the past, some systems rerouted the traffic to alternative 
communication systems, such as satellite communication systems, in case of a failure. However, 
5 satellite communication systems cannot handle a large amount of traffic handled by high- 
capacity fiber optic network systems. To deal with a network failure, some fiber optic 
communication systems rely on a dedicated protection ring or network segment, to which the 
traffic is switched fi-om a failed working communication ring or network segment. 

Protection rings or network segments provisioned for a dynamic restoration of service 
10 need provide a similar magnitude of capacity as working rings or network segments to serve as 
an effective backup or spare links for ensuring network survivability. This means that as much 
as a half of an available network capacity need be set aside as a protection against a network 
failure. 

Besides high-capacity fiber optic network systems, other network systems, such as those 
15 using Tl cables, often feature redundant connections to protect themselves from a failure. For 
example, they may use a dedicated protection ring or network segment. Alternatively, they may 
enforce connections between nodes by adding alternatively routes or duphcate routes. These 
redundant connections, however, increase a cost of building and maintaining network systems. 
Thus, there is a need for providing a resilient closed network capable of automatically 
20 handling a network failure without using a protection ring or network segment and without 
relying on alternative communication systems such as satellite communication systems or 
redundant connections. 
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SUMMARY OF THE INVENTION 

Accordingly, the present invention is directed to a method and system for operation of a 
resiUent closed communication network without a dedicated protection network segment that 
5 substantially obviates one or more of the problems due to hmitations and disadvantages of the 
related art. 

To achieve these and other advantages and in accordance with the purpose of the present 
invention, as embodied and broadly described, the method for operating a resilient closed 
communication network with at least one communication ring includes the step of receiving a 

10 data packet from a first external network at a first distributing station connected to the resihent 
closed communication network. The method also includes the step of identifying a second 
distributing station connected to the resihent closed commxmication network from which the data 
packet is to be forwarded to a second external network and the step of determining ftmctioning 
routes from the first distributing station to the second distributing station. It fiirther includes the 

1 5 step of selecting an optimal route among the fimctioning routes and the step of sending the data 
packet from the first distributing station to the second distributing station using the optimal route. 

In another aspect, the invention includes a method of operating a resilient closed 
communication network, which includes at least one communication ring and a first and a second 
distributing stations. Both the first and the second distributing stations are interconnected by the 

20 at least one communication ring and include a router and a packet distributor. The method 

includes the steps of receiving a data packet from a fnst external network at a first router in the 
first distributing station, forwarding the data packet from the first router to a first packet 
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distributor in the first distributing station, and identifying a network address of a second router in 
the second distributing station from which the data packet is to be forwarded to a second external 
network. In addition, the method includes the steps of determining an identification number of a 
second packet distributor in the second distributing station, appending the identification number 
5 of the second packet distributor to the data packet, and determining functioning routes from the 
first distributing station to the second distributing station. The method also includes the steps of 
selecting an optimal route among the fimctioning routes and sending the data packet from the 
first distributing station to the second distributing station using the optimal route. 

In another aspect, the invention includes a resilient closed communication network, 

10 which includes a first communication ring and at least two distributing stations interconnected by 
the first communication ring. Each distributing station includes means for receiving a data 
packet from an external network or from another distributing station, means for identifying a 
destination distributing station for the data packet, means for appending the identification 
nxmiber of the destination distributing station to the data packet, and means for determining 

15 functioning routes to the destination distributing station. The distributing station further includes 
means for selecting an optimal route among the functioning routes and means for forwarding the 
data packet to an external network after removing the identification number from the data packet 
or to a next distributing station. 

In yet another aspect, the invention includes a resilient closed communication network, 

20 which includes a first communication ring and at least two distributing stations interconnected by 
the first communication ring. Each distributing station includes means for receiving a data 
packet from an extemal network or from another distributing station, means for identifying a 
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destination distributing station for the data packet, means for appending the identification 
number of the destination distributing station to the data packet, and means for determining 
functioning routes to the destination distributing station. The distributing station further includes 
means for selecting an optimal route among the functioning routes, means for appending a route 
5 segment data for the optimal route to the data packet, and means for forwarding the data packet 
to an extemal network after removing the identification number and the route segment data from 
the data packet or to a next distributing station based on the route segment data. 

In a further aspect, the invention includes a resilient closed communication network, 
which includes a first communication ring and at least two distributing stations interconnected by 

10 the first communication ring. Each distributing station includes a router capable of receiving a 
data packet fi:om an extemal network and forwarding a data packet to the extemal network. It 
also includes a packet distributor with means for receiving a data packet from the router or 
another distributing station, means for identifying a destination distributing station of the data 
packet, means for appending the identification number of the destination distributing station to 

15 the data packet, and means for determining functioning routes to the destination distributing 
station. The packet distributor further includes means for selecting an optimal route among the 
functioning routes and means for forwarding the data packet to the router or to another 
distributing station. 

Finally, in another aspect, the invention includes a resilient closed conmiunication 
20 network with a first conmiunication ring and at least two distributing stations interconnected by 
the first communication ring. Each distributing station includes a router capable of receiving a 
data packet fi*om an extemal network and forwarding a data packet to the extemal network. It 
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also includes a packet distributor with means for receiving a data packet from the router or 
another distributing station, means for identifying a destination distributing station of the data 
packet, means for appending the identification number of the destination distributing station to 
the data packet, and means for determining functioning routes to the destination distributing 
5 station. The packet distributor further includes means for selecting an optimal route among the 
functioning routes, means for appending a route segment data for the optimal route to the data 
packet, and means for forwarding the data packet to the router or to another distributing station. 

Additional features and advantages of the invention will be set forth in the description, 
which follows, and in part will be apparent from the description, or may be learned by practice of 

10 the invention. The objectives and other advantages of the invention will be realized and attained 
by the structure particularly pointed out in the written description and claims hereof as well as 
the appended drawings 

It is to be imderstood that both the foregoing general description and the following 
detailed description are exemplary and explanatory and are intended to provide further 

1 5 explanation of the invention as claimed. 



BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are included to provide a further understanding of 
the invention and are incorporated in and constitute a part of this specification, illustrate 
20 embodiments of the invention and together with the description serve to explain the principles of 
the invention. In the drawings: 

7 
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FIG. 1 is a diagram of a preferred embodiment of a resilient closed communication 
network of the present invention; 

FIG. 2 is a diagram depicting one embodiment of the distributing stations of the resilient 
closed conraiunication network of FIG. 1 ; 
5 FIG. 3 is a diagram depicting another embodiment of the distributing stations of the 

resilient closed communication network of FIG. 1; 

FIG, 4 is a flow chart depicting one embodiment of one aspect of an operation performed 
by a distributing station of the present invention; 

FIG. 5 is a flow chart depicting one embodiment of another aspect of an operation 
10 performed by a distributing station of the present invention; 

FIG. 6 depicts one embodiment of a data structure used by a distributing station to sort 
data packets as anticipated by the present invention; 

FIG. 7 depicts one embodiment of a data packet with an identification number as 
anticipated by the present invention; 
15 FIG. 8 depicts another embodiment of a data packet with an identification number and a 

route segment data as anticipated by the present invention; 

FIG. 9 is a flow chart depicting one embodiment of an operation performed by a 
distributing station of the present invention; 

FIG. 10 is a diagram depicting another embodiment of a resihent closed communication 
20 network of the present invention; 

FIG. 11 is a flow chart depicting one embodiment of a process used to select optimal 
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route candidates as anticipated by the present invention; 

FIG. 12 is a flow chart depicting one embodiment of a process used to choose an optimal 
route as anticipated by the present invention; 

FIG. 13 is a diagram depicting one embodiment of a distributing station with a quality of 
5 control (QOS) system; and 

FIG. 14 is flow chart depicting one embodiment of an operation performed by a QOS 
system as anticipated by the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

10 Reference will now be made in detail to the preferred embodiments of the present 

invention, examples of which are illustrated in the accompanying drawings. 

With reference to FIG. 1, one embodiment of a resihent closed communication network 
100 includes a communication ring 101 and four distributing stations 106, 107, 108, and 109. 
The four distributing stations are interconnected by the communication ring 101 . Each 

15 distributing station is also connected to an external network and has a unique identification 

number. In FIG. 1, the distributing station 106 has an identification number A and is connected 
to an external network 102. Similarly, the distributing stations 107, 108, and 109 have 
identification nimibers B, C, and D, respectively, and are connected to external networks 103, 
104, and 105, respectively. 

20 FIG. 2 depicts one embodiment of a distributing station 200 used in a resihent closed 

communication network of the present invention. The distributing station 200 is connected to a 
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communication ring 201 . It is also connected to an external network 202. It includes a router 
203 and a packet distributor 204. The router 203 is capable of receiving a data packet from the 
external network 202. It also forwards a data packet received from the packet distributor 204 to 
the external network 202. The packet distributor 204 receives a data packet from the router 203 
5 or from another distributing station in the resiUent closed communication network. It also 
forwards a data packet to the router 203 or to another distributing station in the resilient closed 
communication network. 

Connections between routers and packet distributors belonging to the same distributing 
stations need belong to the same network segment. In other words, when using an IP-based 

10 network, their IP addresses have the same network and sub-network IP addresses. For example, 
connections between a router and a corresponding packet distributor in the distributing stations 
106, 107, 108 and 109 of FIG. 1 share the same network and sub-network IP addresses. Portions 
of the routers connected to external networks, on the other hand, need have different sub-network 
IP addresses. Furthermore, connections among packet distributors within the resiUent closed 

15 communication network do not have to belong to the same network segment. Although such 
connections must have different sub-network IP addresses if IP-protocols are used to exchange 
information among packet distributors, they may share the same sub-network addresses when 
using non-IP-based protocols. Other methods of assigning network and sub-network IP 
addresses to various components of the resihent closed communication network will be known to 

20 those skilled in the art, and are within the scope of the present invention. 

FIG. 3 shows another embodiment of a distributing station 300 used in a resilient closed 
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communication network of the present invention. The distributing station 300 is particularly 
suitable for a use in ocean-spanning submarine fiber optic communication networks. The 
distributing station 300 may be used at landing points of ocean-spanning submarine fiber optic 
communication networks. Currently, ocean-spanning submarine fiber optic communication 
5 networks set aside a dedicated protection network segment to deal with a network failure. As 
described below, the distributing station 300 enables a network to effectively handle a network 
failure without relying on a dedicated protection network segment. In other words, the 
distributing station 300 eliminates a need to set aside a dedicated protection network segment 
within large-scale ocean-spanning submarine fiber optic communication networks, thus resulting 

10 in more efficient utilization of the networks. 

The distributing station 300 is connected to a communication ring 301, which is a fiber 
optic ring. The distributing station 300 is also connected to an external network 302. It includes 
a router 303, a packet distributor 304, and a submarine cable adopter 305. The router 304 is 
capable of receiving a data packet from the external network 302 or from the packet distributor 

1 5 304. It is also capable of forwarding a data packet to the extemal network 302 or to the packet 
distributor 304, The packet distributor 304 receives a data packet from the router 303 or from 
another distributing station via the submarine cable adapter 305. It sends a data packet to the 
router 303 or to another distributing station via the submarine cable adapter 305. Although FIG. 
3 features the submarine cable adopter 305 inside the distributing station 300, the submarine 

20 cable adopter 305 may reside outside the distributing station 300 as a separate component. 

While the distributing stations depicted in FIGS. 2 and 3 feature a router and a packet 
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distributor, it is not necessary to have both a router and a packet distributor. Those skilled in the 
art would know that one could implement operations performed by a router and a packet 
distributor in one device. For example, existing routers, such as those currently used in a closed 
communication network, may be programmed to implement the resilient closed communication 
5 network of the present invention. 

FIG. 4 depicts one embodiment of one aspect of an operation performed by a distributing 
station that receives a data packet from its extemal network. The operation depicted in FIG. 4 
may be implemented using computer programs that run on devices within the distributing station, 
such as a router and a packet distributor. 

10 The distributing station receives a data packet from an extemal network at step 401. 

When using the distributing stations shown in FIGS. 2 and 3, a router is used at step 401. At step 
402, a network address of a destination distributing station is extracted from the data packet. A 
destination distributing station is a station from which the data packet is to be forwarded out of 
the resihent closed communication network to an extemal network. A network address of the 

15 destination distributing station may be an IP address of a router inside the destination distributing 
station. At step 403, an identification number for the data packet is determined based on the 
network address of the destination distributing station. While the network address of the 
destination distributing station may be used as an identification number, it is preferable to assign 
a short unique identification number to each distributing station within the resilient closed 

20 communication network. Each distributing station usually maintains a table containing an 
identification number and a network address of each distributing station within the resilient 
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closed communication network. When using the distributing stations shown in FIGS. 2 and 3, a 
packet distributor typically performs steps 402 and 403. 

At step 404, the data packet is sorted based on the identification number determined in 
step 403. While such sorting is not necessary, it is recommended to increase a performance of a 
5 distributing station. When using the distributing stations shown in FIGS. 2 and 3, a packet 
distributor is used during the sorting step. 

In implementing this step, each packet distributor may maintain a hst of distributing 
cases. For example, FIG. 6 shows a Ust of distributing cases 600, 601, and 602 for the packet 
distributor in the distributing station 108 in FIG. 1. The three distributing cases 600, 601, and 

10 602 corresponds to the three possible destination distributing stations for a data packet entering 
into the distributing station 108 from the extemal network 104, namely the distributing stations 
106, 107, and 109 or A, B, and D. At step 404, a data packet that has A as its identification 
number, for example, is put in the distributing case A 600. Similarly, the distributing case B 601 
is used for data packets with an identification number B and the distributing case D 602 is used 

1 5 for data packets with an identification number D . 

At step 405, an optimal route is determined. Optimization factors considered in 
determining an optimal route includes an available traffic volume, an actual distance value, and a 
preference value. An available traffic volume indicates a utilization level of a route. An actual 
distance value represents a length of a route. A preference value represents a preference or 

20 policy of a network operator. The three factors are discussed below in depth using one 

embodiment of the step 405 as illustrated in FIGS. 1 1 and 12. Although all three factors are used 
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to determine an optimal route in the embodiment illustrated in FIGS. 1 1 and 12, it is not required 
to do so. 

At step 406, the identification number is appended to the data packet. Referring to FIG. 
7, the identification number may be appended as a header 700 to the data packet 701 . The size of 
5 a header depends on the number of distributing stations in a resilient closed communication 
network. For the network in FIG. 1, the header need be at least two-bit long. Alternatively, the 
identification number may be appended as a tailer to a data packet or using an IP tunneling 
method. At step 407, the data packet is sent to the destination distributing station using the 
optimal route determined in step 405. When using the distributing stations shown in FIGS. 2 and 
10 3, a packet distributor performs steps 405 through 407. 

At step 408, the data packet is forwarded to an external network connected to the 
destination distributing station. When using the distributing stations shown in FIGS. 2 and 3, a 
packet distributor in the destination distributing station receives the data packet and forwards it 
to a router in the destination distributing station. Then the router forwards the data packet to the 
1 5 external network. 

FIG. 5 depicts an operation performed by a distributing station that receives a data packet 
from another distributing station in a resihent closed communication network of the present 
invention. At step 502, the distributing station receives a data packet from another distributing 
station. At step 503, it compares the identification number appended to the data packet with its 
20 own identification number. If they are the same, the distributing station is the destination 

distributing station for the data packet and thus forwards the data packet to the external network 
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at step 506. 

When using the distributing stations shown in FIGS. 2 and 3, steps 502 through 505 are 
performed by a packet distributor in the distributing station. As to step 506, a packet distributor 
forwards the data packet to a router in the same distributing station and then the router forwards 
5 it to the external network. 

If there is no match, the data packet is forwarded to a next distributing station at step 504. 
The next distributing station must be different from the distributing station from which the data 
packet was received. When using the distributing stations shown in FIGS. 2 and 3, a packet 
distributor performs step 504. 
10 FIG. 8 shows a data packet 801 with an identification number 800 and a route segment 

data 803. A route segment data is a hst of a plurality of route segment numbers 803a, 803b, etc. 
In FIG. 8, the identification number 800 is appended to the data packet 801 as a header, and the 
route segment data 803 as a trailer. 

It is not necessary to identify a route segment data 803 for a resiUent closed 
1 5 conmiunication network with one communication ring, such as one shown in FIG. 1 . A route 
segment data 803, however, is needed for a resilient closed communication network with at least 
one distributing station connected to more than one communication lines, such as one shown in 
FIG. 10. In FIG. 10, a resilient closed commxmication network 1000 includes a commxmication 
ring 1001 and two communication lines 1002 and 1011. It also includes four distributing stations 
20 1007, 1008, 1009, and 1010. The distributing stations 1007, 1008, 1009, and 1010 are connected 
to external networks, 1003, 1004, 1005, and 1006, respectively. 
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The four distributing stations divide the communication ring 1001 into four route 
segments 1001a, 1001b, 1001c, and lOOld. The communication lines 1002 and 1011 have one 
route segment 1002 and 1011. Each route segment is given a route segment number and each 
distributing station maintains information on route segment numbers for all the route segments 
5 within the resiUent closed communication network. 

Referring back to FIG. 8, the route segment data 803 consisting of route segment 
numbers is appended to the data packet 801 as a tailer. The route segment data 803 is appended 
before the data packet leaves a distributing station in which its optimal route is determined. It 
may be added along with the identification number 800, A route segment data may be added as a 

10 header, a tailer, or using an IP txmneling method. 

FIG. 9 illustrates how a data packet with both an identification number and a route 
segment data is processed by a distributing station. In this embodiment, a route segment data is a 
list containing route segment numbers of the optimal route in a reverse order and is appended to 
the data packet as a tailer as shown in FIG. 8. At step 902, a distributing station receives a data 

15 packet with an identification number and a route segment data from another distributing station. 
At step 903, the distributing station checks whether its identification number is the same as the 
identification number appended to the data packet. If so, it removes the identification number 
from the data packet and forwards the data packet to an external network. Otherwise, it extracts 
a route segment number from the route segment data at step 904 and removes the extracted route 

20 segment number from the route segment data at step 905. It then forwards the data packet to a 
next distributing station using a route segment with the extracted route segment number at step 
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906. When using the distributing stations shown in FIGS. 2 and 3, steps 902 through 907 are 
typically performed by a packet distributor and step 908 is performed using both a packet 
distributor and a router. 

The process illustrated in FIG. 9 is further explained using an example. The example 
5 uses a resilient closed communication network shown in FIG. 10 and a distributing station shown 
in FIG. 2. A data packet enters the resihent closed communication network via the external 
network 1003. The data packet is, thus, received by a router in the distributing station A and is 
forwarded to a packet distributor for processing. The packet distributor first determines the 
destination packet distributor for the data packet, which, we assume, is the distributing station B. 

10 If the packet distributor in the distributing station A 1007 determines that an optimal route 
between the distributing station A 1007 and the distributing station B 1008 consists of route 
segments lOOld, 1001c, and 1001b, a route segment data is a hst containing 1001c and 1001b. It 
is not necessary to add the route segment 100 Id to the list. The route segment data is appended 
to the data packet as a tailer. The identification number B is also appended to the data packet as 

15 a header. The data packet is then sent to the distributing station D 1010 using the route segment 
100 Id. At the distributing station D 1010, the packet distributor first compares its identification 
number with the identification number contained in the header of the data packet. Since they are 
different, it extracts a route segment number 1001c fi:om the route segment data appended to the 
data packet. After removing the extracted route segment number fi-om the data packet, it sends 

20 the data packet to the distributing station C 1009 using the route segment 1001c. The packet 
distributor in the distributing station C 1009 receives the data packet and determines that its 
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identification number is different from the identification number in the header of the data packet. 
It extracts the route segment number 1001b from the route segment data and then removes it. At 
this point, all the route segment numbers are removed. In other words, the data packet no longer 
has a tailer. Then, the packet distributor in the distributing station C 1009 forwards the data 
packet to the distributing station B 1008 using the route segment 1001b. The packet distributor 
in the distributing station B 1008, after determining that its identification number is the same as 
the identification number contained in the data packet, removes the identification number and 
forwards the data packet to the router in the distributing station B 1008. Finally, the router 
forwards the data packet to the external network 1004. 

FIG. 11 is a flow chart illustrating how optimal route candidates are selected. When 
using the distributing stations in FIGS. 2 and 3, a packet distributor performs the operation 
illustrated in FIG. 11. 

A distributing station maintains a routing table including all available routes between it 
and the other distributing stations in a resilient closed communication network. When using the 
distributing stations shown in FIGS. 2 and 3, a packet distributor typically maintains such a 
routing table. If a database in FIG. 6 is used to sort data packets according to their destinations, a 
distributing station may maintain a separate routing table for each distributing case. In other 
words, each distributing case has a routing table listing all available routes to the corresponding 
distributing station. 

With reference to FIG. 1 1, a distributing station finds available routes to a destination 
distributing station by accessing a routing table at step 1 102. At step 1 1 03, the distributing 
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station determines which of the available routes are functional by electrically checking a 
connection of route segments. 

Route segment connection information is communicated among the distributing stations 
in the resiUent closed communication network. When using distributing stations with a router 
5 and a packet distributor, one may assign a private network address, such as a private IP address, 
to each packet distributor within the resilient closed communication network to facilitate 
communication among the packet distributors. Furthermore, each packet distributor maintains a 
inter-distributor communication route table, which contains a list of routes to be used to send 
route segment connection information to the other packet distributors within the resihent closed 

10 communication network. The inter-distributor communication route table may contain one or 
more routes to a destination packet distributor. The inter-distributor communication route table 
is typically maintained by a network administrator and its entries remain the same unless 
changed by the network administrator. Using a route specified in the inter-distributor 
conmiunication route table, each packet distributor is to send route segment connection 

1 5 information regarding route segments adjacent to it to the other packet distributors. 

An IP-based protocol may be used to send a data packet containing route segment 
connection information. A data packet used to send route segment connection inforaiation may 
include a route segment number, its connection status, and a private network address or an 
identification number of a destination packet distributor. In addition, the data packet may 

20 include a time stamp indicating when a route segment connection information was gathered. 

When the data packet arrives at the destination packet distributor, the destination packet 
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distributor sends an acknowledgement data packet to the packet distributor that originally sent 
the data packet. The destination packet distributor also updates route segment connection 
information, if necessary. When updating, it checks a time stamp to make sure that the data 
packet contains more recent information. 
5 The packet distributor keeps resending a data packet until it receives an acknowledgment 

data packet. For example, if the packet distributor does not receive an acknowledgement data 
packet within a first predetermined amount of time, it resends a data packet using the same route. 
It may resend the data packet again if it does not receive an acknowledgement data packet within 
another first predetermined amount of time. If an acknowledgement data packet does not arrive 

10 within a second predetermined amount of time, it may resend a data packet using an alternative 
route specified in the inter-distributor communication route table. 

Instead of using the IP-protocol based method described above to communicate route 
segment connection information, other existing protocols, such as Transport Control Protocol 
(TCP) as described in Christian Huitema, Routing in the Internet (2nd ed. 1999), may be used. 

1 5 Alternatively, the above method may be altered so that a data packet travels within the resilient 
closed optical commxmication network until all the packet distributors receive the data packet. 

Each distributing station maintains a table containing route segment connection 
information for each route segment within the closed resiUent communication network. At step 
1 103, the distributing station uses this table to select fimctioning routes among available routes. 

20 Specifically, for each available route, it checks connection information for every route segment 
that comprises the available route. If every route segment is connected or fimctioning, then the 
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available route is considered a functioning route. 

At step 1 104, the distributing station determines whether there are at least two 
functioning routes. If so, it continues to step 1 105. If there is only one functioning route, the 
distributing station designates it as an optimal route at step 1113. 
5 At step 11 05, the distributing station calculates an available traffic volume for each 

functioning route. The distributing station maintains a table of available traffic volumes for 
every route segment in the resilient closed communication network. An available traffic volume 
is a difference between an effective traffic volume for a route segment and an actual traffic 
volume for that route segment. Initially, an available traffic volume of a route segment may 
10 equal an effective traffic volume of that route segment. Alternatively, a network operator may 
assign an arbitrary value. Once the resihent closed communication network begins to operate, an 
available traffic volume is updated periodically to convey network congestion information in real 
time. 

An actual traffic volume is determined by measuring a size of data packets that are sent 
15 through a route segment. An actual traffic volume is measured in terms of bits per second. Each 
distributing station is responsible for measuring an actual traffic volume of route segments that 
are directly connected to it and for communicating the values to the other distributing stations in 
the resihent closed communication network. The distributing stations may update an actual 
traffic volume periodically, such as every 10 seconds. The distributing stations may be 
20 programmed measure actual traffic volumes at the same time. To facilitate a simultaneous 
measuring of actual traffic volumes, the closed resihent communication network may use an 
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internal clock. 

The distributing stations communicate actual traffic volumes using an inter-distributor 
communication method similar to the one used to communicate route segment connection 
information. A data packet for communicating an actual traffic volume would contain an actual 
5 traffic volume, a corresponding route segment number, and a time stamp indicating when the 
actual traffic volume was measured. It may further include a network address or an identification 
number of a destination packet distributor. Each packet distributor may maintain a table 
containing actual traffic volumes for every route segment within the resilient closed 
communication network. Whenever a packet distributor receives a data packet containing an 
10 actual traffic volume, a corresponding entry in the table is updated, if necessary. 

The effective traffic volume is an amount of data that a route segment can handle, 
expressed in terms of bits per second. This volume is typically set by a network operator and is 
less than or equal to the maximum traffic volume that the route segment can handle. 

To calculate an available traffic volume for a functioning route between two distributing 
15 stations, a distributing station first determines an available traffic volume for each route segment 
of the functioning route. The available traffic volume of the functioning route equals the 
smallest available traffic volume among the available traffic volumes of its route segments. 

At step 1 106, the distributing station determines whether there is at least one functioning 
route with an available traffic volume that is greater than or equal to zero. If not, it chooses 
20 functioning routes with the largest available traffic volume as optimal route candidates at step 
1112. Otherwise, it determines whether at least one functioning route has an available traffic 
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volume that is greater than zero at step 1 107. 

If the largest available traffic volume is zero, it determines an actual distance value for 
each functioning route that has zero as its available traffic volume at step 1110. An actual 
distance value is a distance between a distributing station that receives a data packet from an 
external network and a destination distributing station from which the data packet is forwarded to 
another external network. Typically, each distributing station maintains a distance table 
containing a length of each route segment, which is predetermined by a network operator. 
Instead of maintaining a distance table, a distributing station may record an actual distance value 
for each route in its routing table. To determine an actual distance value for a ftmctioning route, 
the distributing station accesses the distance table to obtain a length of all the route segments for 
the ftmctioning route. The actual distance value of the fiinctioning route equals the sum of the 
lengths of it route segments. At step 1 1 1 1, the distributing station chooses among the 
ftmctioning routes with the available traffic volume of zero, those with the smallest actual 
distance value as optimal route candidates. 

If at least one ftmctioning route has a positive available traffic volume, the distributing 
station calculates an actual distance value for each ftmctioning route with a positive available 
traffic volume at step 1 108. Among the ftmctioning routes with a positive available traffic 
volume, it chooses those with the smallest actual distance value as optimal route candidates at 
1109. 

FIG. 12 illustrates one embodiment of a process used to select an optimal route among 
optimal route candidates determined at step 1201. If there is only one optimal route candidate, 
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then it is designated as an optimal route, as illustrated in steps 1202 and 1205, If there are at 
least two optimal route candidates, the distributing station calculates a preference value for each 
optimal route candidate at 1203. When using the distributing stations shown in FIGS. 2 and 3, a 
packet distributor typically performs the steps in FIG. 12 and maintains a data, such as a 
5 preference value table, that is necessary to perform the steps. 

A preference value is used to designate certain routes as preferred routes. A network 
operator typically sets preference values. A distributing station may maintain a preference value 
table. A preference value table, for example, may contain a list of preferred routes. At step 
1203, a distributing station then gives a preference value of one to those optimal route candidates 

10 Usted in the preference table and zero to those that are not listed. Altematively, a preference 

table may contain a preference value for each route segment and a preference value of an optimal 
route candidate may be defined as a sum of preference values of its route segments. Then at step 
1203, a distributing station calculates preference values for each optimal route candidate by 
adding preference values of its route segments. 

15 At step 1204, the distributing station chooses an optimal route candidate with the largest 

preference value as an optimal route. If two or more optimal route candidates have the same 
preference value, then the distributing station may choose one arbitrarily. Instead of using a 
preference value, as illustrated in FIG, 12, one may randomly choose any one of optimal route 
candidates as an optimal route. 

20 FIG. 13 is a diagram showing a distributing station 1301 that is connected to an external 

network 1305 and a communication ring 1306. The distributing station 1301 has a router 1302, a 
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packet distributor 1303, and a quality of service (QOS) system 1304. The QOS system 1304 is 
used to control a flow of data packets within the resihent closed communication network. 
Although FIG. 13 shows the QOS system 1304 inside the distributing station 1301, the QOS 
systeml304 may reside outside the distributing station 1301 as a separate component. 
5 Alternatively, a QOS system may be installed for each route segment. Specifically, two QOS 
systems may be installed outside the distributing station 1301, assigning one QOS system to each 
route segment directly connected to the distributing station 1301. Moreover, the functions 
performed by a router 1302, a packet distributor 1303, and a QOS system 1304 may be 
implemented in one device. 

10 FIG. 14 depicts one embodiment of an operation performed by a QOS system. At step 

1401, the QOS system checks whether an optimal route has a negative available traffic volume. 
If the optimal route has a negative available traffic volimie, then the QOS system is used. 
Otherwise, the data packet is sent to the next distributing station. In other words, the QOS 
system is not used when an optimal route has a non-negative available traffic volume. Only 

15 when an optimal route has a negative available traffic volume, that is when an actual traffic 

volume of at least one route segment of the optimal route exceeds an effective traffic volume of 
that segment, the QOS system is turned on. Once the resilient closed communication network 
becomes uncongested, that is once an available traffic volume for an optimal route becomes 
greater than or equal to zero, the QOS system is turned off and the data packet is immediately 

20 sent to the next distributing station at 1405. 

If the optimal route has a negative actual traffic volume, the QOS system assigns a QOS 
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value to the data packet at step 1402. The QOS value represents a sending priority assigned to 
that data packet. For example, the system may decide to send data packets originating from an 
Internet service provider X before sending data packets from an Internet service provider Y, 
when the system is congested. The QOS system may maintain a QOS table assigning a QOS 
5 value based on information contained in a transport layer of a data packet using an Open Systems 
Interconnection (OSI) model. At step 1403, the data packet is placed in a QOS queue based on 
its QOS value. The QOS queue is managed so that the data packet with the highest QOS value 
is sent first. To avoid an infinite delay, it may increase a QOS value of data packets in the queue 
periodically. The size of QOS queue depends on an effective traffic volume of a route segment 

10 connected to it. At step 1404, the data packet is removed from the QOS queue and sent to the 
next distributing station at 1405. 

While FIG. 13 shows the QOS system 1304 as a separate system, it may be incorporated 
into the packet distributor 1303. If the QOS system is a separate system as shown in FIG. 13, it 
is necessary to allow a communication between the QOS system and the distributing station, so 

15 that the QOS system has an access to available traffic volumes. An electronic circuit may be 
used to connect the QOS system and the distributing station. Furthermore, it may be preferable 
to maintain a separate QOS system for each route segment. 

It will be apparent to those skilled in the art that various modifications and variations can 
be made in the method and system for operation of a resiUent closed communication network 

20 without a dedicated protection network segment of the present invention without departing from 
the spirit or scope of the invention. Thus, it is intended that the present invention covers the 
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modifications and variations of this invention provided they come within the scope of the 
appended claims and their equivalents. 
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What Is Claimed Is : 

1 . A method for operating a resilient closed communication network comprising at 
least one communication ring, the method comprising the steps of: 

receiving a data packet from a first external network at a first distributing station 
5 connected to the resilient closed communication network; 

identifying a second distributing station connected to the resilient closed communication 
network from which the data packet is to be forwarded to a second external network; 

determining functioning routes from the first distributing station to the second 
distributing station within the resilient closed commtmication network; 
10 selecting an optimal route among the functioning routes; and 

sending the data packet from the first distributing station to the second distributing station 
using the optimal route. 

2. The method according to claim 1, wherein optimization factors including an 
available traffic volume, an actual distance value, and a preference value are considered in the 

15 selecting step. 

3. The method according to claim 1, wherein the selecting step includes the steps of 
calculating an available traffic volume for each of the functioning routes; 
maintaining a distance table containing information necessary to determine an actual 

distance value for each of the functioning routes; 
20 finding optimal route candidates, which are routes with the smallest actual distance value 

among the functioning routes with a positive available traffic volume if at least one functioning 
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route has a positive available traffic volume, routes with the smallest actual distance value 
among the functioning routes with an available traffic volume of zero if the largest available 
traffic volume for the functioning routes is zero, or routes with the largest available traffic 
volume if all the functioning routes have a negative available traffic volume; and 
5 choosing an optimal route from the optimal route candidates. 

4. The method according to claim 3, wherein the choosing step uses a preference 
value to select an optimal route when there are at least two optimal route candidates. 

5. The method according to claim 4, further comprising the step of prioritizing an 
order of sending the data packet when the optimal route has a negative available traffic volume. 

10 6. The method according to claim 5, wherein the prioritizing step uses information 

contained in a transport layer of the data packet using an OSI model. 

7. The method according to claim 3, further comprising the step of prioritizing an 
order of sending the data packet when the optimal route has a negative available traffic volume. 

8. The method according to claim 7, wherein the prioritizing step uses information 
15 contained in a transport layer of the data packet using an OSI model. 

9. The method according to claim 1, wherein no segment of the at least one 
communication ring is used as a dedicated protection segment. 

10. The method according to claim 1, wherein the at least one communication ring is 
made of fiber optic cables. 

20 11. The method according to claim 1 , further comprising the steps of: 

appending an identification number of the second distributing station to the data packet 
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before it leaves the first distributing station; 

receiving the data packet at a third distributing station from the first distributing station; 

and 

forwarding the data packet to the second external network connected to the third 
5 distributing station after removing the identification number from the data packet, if the 

identification number of the third distributing station is the same as the identification number 
appended to the data packet, or otherwise forwarding the data packet to a fourth distributing 
station that is different from the first distributing station. 

12. The method according to claim 1 1 , wherein optimization factors including an 
10 available traffic volume, an actual distance value, and a preference value are considered in the 

selecting step. 

13. The method according to claim 11, wherein the selecting step includes the steps 

of: 

calculating an available traffic volume for each of the ftmctioning routes; 
15 maintaining a distance table containing information necessary to determine an actual 

distance value for each of the functioning routes; 

finding optimal route candidates, which are routes with the smallest actual distance value 
among the functioning routes with a positive available traffic volume if at least one of the 
functioning routes has a positive available traffic volume, routes with the smallest actual distance 
20 value among the functioning routes with an available traffic volume of zero if the largest 

available traffic volume for the fixnctioning routes is zero, or routes with the largest available 
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traffic volume if all the functioning routes have a negative available traffic volume; and 
choosing an optimal route from the optimal route candidates. 

14. The method according to claim 13, wherein the choosing step uses a preference 
value to select an optimal route when there are at least two optimal route candidates. 
5 15. The method according to claim 14, further comprising the step of prioritizing an 

order of sending the data packet when the optimal route has a negative available traffic volume. 

16. The method according to claim 15, wherein the prioritizing step uses information 
contained in a transport layer of the data packet using an OSI model. 

17. The method according to claim 13, further comprising the step of prioritizing an 
10 order of sending the data packet when the optimal route has a negative available traffic volume. 

18. The method according to claim 17, wherein the prioritizing step uses information 
contained in a transport layer of the data packet using an OSI model. 

19. The method according to claim 11, wherein no segment of the at least one 
communication ring is used as a dedicated protection segment. 

15 20. The method according to claim 11, wherein the at least one communication ring is 

made of fiber optic cables. 

21 . The method according to claim 1, further comprising the steps of: 
appending an identification number of the second distributing station and a route segment 
data specifying the optimal route to the data packet before it leaves the first distributing station; 
20 receiving the data packet at a third distributing station from the first distributing station; 

and 
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forwarding the data packet to the second external network connected to the third 
distributing station after removing the identification number and the route segment data, if the 
identification number of the third distributing station is the same as the identification number 
appended to the data packet, or otherwise forwarding the data packet to a fourth distributing 
5 station that is different from the first distributing station using the route segment data. 

22. The method according to claim 21, wherein the forwarding step further includes 
the steps of: 

if the identification number of the third distributing station is different from the 
identification number appended to the data packet, 
10 extracting a route segment number of the route segment data; 

removing the route segment number obtained in the extracting step from the route 
segment data; and 

forwarding the data packet to a fourth distributing station using a route segment with the 
route segment number obtained in the extracting step. 
15 23, The method according to claim 21, wherein optimization factors including an 

available traffic volume, an actual distance value, and a preference value are considered in the 
selecting step. 

24. The method according to claim 21, wherein the selecting step includes the steps 

of: 

20 calculating an available traffic volume for each of the functioning routes; 

maintaining a distance table containing information necessary to determine an actual 
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distance value for each of the functioning routes; 

finding optimal route candidates, which are routes with the smallest actual distance value 
among the functioning routes with a positive available traffic volume if at least one of the 
functioning routes has a positive available traffic volume, routes with the smallest actual distance 
5 value among the functioning routes with an available traffic volume of zero if the largest 
available traffic volume for the functioning routes is zero, or routes with the largest available 
traffic volimie if all the functioning routes have a negative available traffic volume; and 

choosing an optimal route fi^om the optimal route candidates. 

25. The method according to claim 24, wherein the choosing step uses a preference 
10 value to select an optimal route when there are at least two optimal route candidates. 

26. The method according to claim 25, further comprising the step of prioritizing an 
order of sending the data packet when the optimal route has a negative available traffic volume. 

27. The method according to claim 26, wherein the prioritizing step uses information 
contained in a transport layer of the data packet using an OSI model. 

15 28. The method according to claim 24, further comprising the step of prioritizing an 

order of sending the data packet when the optimal route has a negative available traffic volume. 

29. The method according to claim 28, wherein the prioritizing step uses information 
contained in a transport layer of the data packet using an OSI model. 

30. The method according to claim 21, wherein no segment of the at least one 
20 communication ring is used as a dedicated protection segment. 

3 1 . The method according to claim 21, wherein the at least one communication ring is 
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made of fiber optic cables. 

32. A method of operating a resilient closed communication network comprising at 
least one conmiimication ring, a first distributing station, and a second distributing station 
wherein the first and the second distributing stations are interconnected by the at least one 

5 communication ring and have a router and a packet distributor, the method comprising the steps 
of: 

receiving a data packet fi-om a first extemal network at a first router in the first 
distributing station; 

forwarding the data packet firom the first router to a first packet distributor in the first 
1 0 distributing station; 

identifying a network address of a second router in the second distributing station fi-om 
which the data packet is to be forwarded to a second extemal network; 

determining an identification number of a second packet distributor in the second 
distributing station; 

1 5 appending the identification number of the second packet distributor to the data packet; 

determining fimctioning routes firom the first distributing station to the second 
distributing station within the resilient closed communication network; 
selecting an optimal route among the fimctioning routes; and 

sending the data packet fi-om the first distributing station to the second distributing station 
20 using the optimal route. 

33. The method according to claim 32, wherein optimization factors including an 
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available traffic volume, an actual distance value, and a preference value are considered in the 
selecting step. 

34. The method according to claim 32, wherein the selecting step includes the steps 

of: 

5 calculating an available traffic volume for each of the functioning routes; 

maintaining a distance table containing information necessary to determine an actual 
distance value for each of the functioning routes; 

finding optimal route candidates, which are routes with the smallest actual distance value 
among the functioning routes with a positive available traffic volume if at least one of the 
10 functioning routes has a positive available traffic volume, routes with the smallest actual distance 
value among the functioning routes with a traffic volume of zero if the largest available traffic 
volume of the functioning routes is zero, or routes with the largest available traffic volume if all 
the functioning routes have a negative available traffic volume; and 
choosing an optimal route from the optimal route candidates. 
15 35. The method according to claim 34, wherein the choosing step uses a preference 

value to select an optimal route when there are at least two optimal route candidates. 

36. The method according to claim 35, further comprising the step of prioritizing an 
order of sending the data packet when the optimal route has a negative available traffic volume. 

37. The method according to claim 36, wherein the prioritizing step uses information 
20 contained in a transport layer of the data packet using an OSI model. 

38. The method according to claim 34, further comprising the step of prioritizing an 
order of sending the data packet when the optimal route has a negative available traffic volume. 
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39. The method according to claim 38, wherein the prioritizing step uses information 
contained in a transport layer of the data packet using an OSI model. 

40. The method according to claim 34, wherein no segment of the at least one 
communication ring is used as a dedicated protection segment. 

5 41 . The method according to claim 34, wherein the at least one communication ring is 

made of fiber optic cables. 

42. The method according to claim 32, further comprising the steps of: 
receiving the data packet at a third packet distributor in a third distributing station fi-om 

the first distributing station; and 

10 forwarding the data packet to a third router in the third distributing station fi-om the third 

packet distributor for sending to the second external network connected to the third distributing 
station after removing the identification number fi-om the data packet, if the identification 
nximber of the third packet distributor is the same as the identification number appended to the 
data packet, or otherwise forwarding the data packet to a fourth distributing station that is 

15 different from the first distributing station. 

43. The method according to claim 42, wherein optimization factors including an 
available traffic volume, an actual distance value, and a preference value are considered in the 
selecting step. 

44. The method according to claim 42, wherein the selecting step includes the steps 

20 of: 

calculating an available traffic volume for each of the fimctioning routes; 
maintaining a distance table containing information necessary to determine an actual 

36 

l-WA/1349263.1 

i 



distance value for each of the functioning routes; 

finding optimal route candidates^ which are routes with the smallest actual distance value 
among the functioning routes with a positive available traffic volume if at least one of the 
functioning routes has a positive available traffic volume, routes with the smallest actual distance 
5 value among the functioning routes with a traffic volume of zero if the largest available traffic 
volume of the functioning routes is zero, or routes with the largest available traffic volume if all 
the functioning routes have a negative available traffic volume; and 
choosing an optimal route fi*om the optimal route candidates. 

45. The method according to claim 44, wherein the choosing step uses a preference 
10 value to select an optimal route when there are at least two optimal route candidates. 

46. The method according to claim 45, further comprising the step of prioritizing an 
order of sending the data packet when the optimal route has a negative available traffic volume. 

47. The method according to claim 46, wherein the prioritizing step uses information 
contained in a transport layer of the data packet using an OSI model. 

15 48. The method according to claim 44, further comprising the step of prioritizing an 

order of sending the data packet when the optimal route has a negative available traffic volume. 

49. The method according to claim 48, wherein the prioritizing step uses information 
contained in a transport layer of the data packet using an OSI model. 

50. The method according to claim 42, wherein no segment of the at least one 
20 communication ring is used as a dedicated protection segment. 

5 1 . The method according to claim 42, wherein the at least one communication ring is 
made of fiber optic cables. 
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52. The method according to claim 32 further comprising the steps of: 
appending a route segment data for the optimal route to the data packet before the data 

packet leaves the first packet distributor; 

receiving the data packet at a third packet distributor in a third distributing station from 
5 the first distributing station; and 

forwarding the data packet to a third router m the third distributing station fi:om the third 
packet distributor for sending to the second external network connected to the third distributing 
station after removing the identification number and the route segment data, if the identification 
number of the third packet distributor is the same as the identification number appended to the 
10 data packet, or otherwise forwarding to a fourth distributing station that is different firom the first 
distributing station using the route segment data. 

53, The method according to claim 52, wherein optimization factors including an 
available traffic volume, an actual distance value, and a preference value are considered in the 
selecting step. 

15 54. The method according to claim 52, wherein the selecting step includes the steps 

of: 

calculating an available traffic volume for each of the functioning routes; 

maintaining a distance table containing information necessary to determine an actual 
distance value for each of the functioning routes; 
20 finding optimal route candidates, which are routes with the smallest actual distance value 

among the functioning routes with a positive available traffic volume if at least one of the 
functioning routes has a positive available traffic volume, routes with the smallest actual distance 
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value among the functioning routes with a traffic volume of zero if the largest available traffic 
volume of the functioning routes is zero, or routes with the largest available traffic volume if all 
the functioning routes have a negative available traffic volume; and 
choosing an optimal route firom the optimal route candidates. 
5 55. The method according to claim 54, wherein the choosing step uses a preference 

value to select an optimal route when there are at least two optimal route candidates. 

56. The method according to claim 55, further comprising the step of prioritizing an 
order of sending the data packet when the optimal route has a negative available traffic volimie. 

57. The method according to claim 56, wherein the prioritizing step uses information 
10 contained in a transport layer of the data packet using an OSI model. 

58. The method according to claim 54, further comprising the step of prioritizing an 
order of sending the data packet when the optimal route has a negative available traffic volume. 

59. The method according to claim 58, wherein the prioritizing step uses information 
contained in a transport layer of the data packet using an OSI model. 

15 60. The method according to claim 52, wherein no segment of the at least one 

communication ring is used as a dedicated protection segment. 

61. The method according to claim 52, wherein the at least one communication ring is 
made of fiber optic cables. 

62. The method according to claim 52, wherein the forwarding step further comprises 
20 the steps of: 

if the identification number of the third packet distributor is different from the 
identification number appended to the data packet, 

39 

l-WA/ 1349263.1 



extracting a route segment number from the route segment data; 
removing the route segment number obtained in the extracting step from the route 
segment data; and 

forwarding the data packet to a fourth distributing station using a route segment with the 
5 route segment number obtained in the extracting step. 

63. The method according to claim 32, wherein no segment of the at least one 
communication ring is used as a dedicated protection segment. 

64. The method according to claim 32, wherein the at least one communication ring is 
made of fiber optic cables. 

10 
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65. A resilient closed communication network comprising: 
a first communication ring; and 

at least two distributing stations interconnected by the first communication ring, each 
distributing station including: 
5 means for receiving a data packet fi'om an external network or from another distributing 

station in the resilient closed communication network; 

means for identifying a destination distributing station for the data packet received fi-om 
the external network; 

means for appending the identification nxmiber for the destination distributing station to 
10 the data packet received firom the external network; 

means for determining functioning routes to the destination distributing station within the 
resilient closed communication network; 

means for selecting an optimal route among the functioning routes; and 
means for forwarding to the external network after removing the identification number 
15 firom the data packet if the identification nimiber of the distributing station is the same as the 
identification number appended to the data packet, or otherwise forwarding the data packet to a 
next distributing station based on the optimal route. 

66. The resilient closed communication network according to claim 65, wherein the 
selecting means considers optimization factors including an available traffic volume, an actual 

20 distance value, and a preference value. 

67. The resiUent closed communication network according to claim 65, wherein the 
selecting means includes: 
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means for calculating an available traffic volume for each of the functioning routes; 

means for maintaining a distance table containing information necessary to determine an 
actual distance value for each of the functioning routes; 

means for finding optimal route candidates, which are routes with the smallest actual 
5 distance value among the functioning routes with a positive available traffic volume if at least 
one of the functioning routes has a positive available traffic volume, routes with the smallest 
available traffic volume if the largest available traffic volume among the functioning routes is 
zero, or routes with the largest available traffic volume if all the functioning routes have a 
negative available traffic volume; and 
10 means for choosing an optimal route fi:om the optimal route candidates. 

68. The resilient closed communication network according to claim 67, wherein the 
choosing means uses a preference value to choose an optimal route when there are at least two 
optimal route candidates. 

69. The resilient closed commxmication network according to claim 68, wherein each 
15 distributing station further includes means for prioritizing an order of sending the data packet 

when the optimal routes has a negative available traffic volume. 

70. The resilient closed communication network according to claim 69, wherein the 
prioritizing means uses information contained in a transport layer of the data packet using an OSI 
model. 

20 71 . The resilient closed communication network according to claim 67, wherein each 

distributing station further includes means for prioritizing an order of sending the data packet 
when the optimal route has a negative available traffic volume. 
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72. The resilient closed communication network according to claim 71, wherein the 
prioritizing means uses information contained in a transport layer of the data packet using an OSI 
model. 

73. The resihent closed communication network according to claim 67, wherein no 
5 segment of the first communication ring is used as a dedicated protection segment. 

74. The resihent closed communication network according to claim 67, wherein the 
first communication ring is made of fiber optic cables. 

75. The resilient closed communication network according to claim 65, wherein no 
segment of the first communication ring is used as a dedicated protection segment. 

1 0 76. The resihent closed communication network according to claim 65, wherein the 

first communication ring is made of fiber optic cables. 
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77, A resilient closed commimication network comprising: 
a first communication ring; and 

at least two distributing stations interconnected by the first communication ring, each 
5 distributing station including: 

means for receiving a data packet from an external network or fi-om another distributing 
station in the resihent closed communication network; 

means for identifying a destination distributing station for the data packet received fi-om 
the extemal network; 

10 means for appending the identification number for the destination distributing station to 

the data packet received fi:om the extemal network; 

means for determining functioning routes to the destination distributing station within the 
resihent closed communication network; 

means for selecting an optimal route among the functioning routes; 
15 means for appending a route segment data for the optimal route to the data packet 

received fi:om the extemal network, and 

means for forwarding to the extemal network after removing the identification number 
and the route segment data from the data packet if the identification number of the distributing 
station is the same as the identification number appended to the data packet, or otherwise 
20 forwarding to a next distributing station using a route segment specified in the route segment 
data after updating the route segment data. 

78. The resihent closed communication network according to claim 77, wherein the 
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selecting means considers optimization factors including an available traffic volume, an actual 
distance value, and a preference value. 

79. The resilient closed communication network according to claim 77, wherein the 
selecting means includes: 
5 means for calculating an available traffic volume for each of the functioning routes; 

means for maintaining a distance table containing information necessary to determine an 
actual distance value for each of the functioning routes; 

means for finding optimal route candidates, which are routes with the smallest actual 
distance value among the functioning routes with a positive available traffic volume if at least 
10 one of the fimctioning routes has a positive available traffic volume, routes with the smallest 
available traffic volume if the largest available traffic volume among the functioning routes is 
zero, or routes with the largest available traffic volume if all the functioning routes have a 
negative available traffic volume; and 

means for choosing an optimal route from the optimal route candidates. 
15 80. The resiUent closed communication network according to claim 79, wherein the 

choosing means uses a preference value to choose an optimal route when there are at least two 
optimal route candidates. 

8 1 . The resilient closed communication network according to claim 80, wherein each 
distributing station further includes means for prioritizing an order of sending the data packet 

20 when the optimal routes has a negative available traffic volume. 

82. The resilient closed communication network according to claim 8 1 , wherein the 
prioritizing means uses information contained in a transport layer of the data packet using an OSI 
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model. 

83. The resilient closed communication network according to claim 79, wherein each 
distributing station further includes means for prioritizing an order of sending the data packet 
when the optimal route has a negative available traffic volume. 
5 84. The resiUent closed communication network according to claim 83, wherein the 

prioritizing means uses information contained in a transport layer of the data packet using an OSI 
model. 

85. The resihent closed communication network according to claim 19, wherein no 
segment of the first communication ring is used as a dedicated protection segment. 
10 86. The resilient closed communication network according to claim 79, wherein the 

first communication ring is made of fiber optic cables, 

87. The resilient closed communication network according to claim 77, wherein no 
segment of the first communication ring is used as a dedicated protection segment. 

88. The resilient closed communication network according to claim 77, wherein the 
1 5 first communication ring is made of fiber optic cables. 
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89. A resilient closed communication network comprising: 
a first commimication ring; and 

at least two distributing stations interconnected by the first coromunication ring, each 
distributing station including: 
5 a router capable of receiving a data packet fi*om an extemal network connected to the 

distributing station and of forwarding the data packet to the extemal network connected to the 
distributing station; and 

a packet distributor comprising: 

means for receiving a data packet fi"om the router in the same distributing station or from 
10 another distributing station in the resihent closed communication network; 

means for identifying a network address of a destination router in the destination 
distributing station for the data packet received from the router in the same distributing station; 

means for determining an identification number of a destination packet distributor in the 
destination distributing station; 
15 means for appending the identification number of the destination packet distributor to the 

data packet received from the router in the same distributing station; 

means for determining fimctioning routes to the destination distributing station within the 
resilient closed communication network; 

means for selecting an optimal route among the functioning routes; and 
20 means for forwarding the data packet to the router in the same distributing station after 

removing the identification niunber from the data packet if the identification number of the 
distributing station is the same as the identification number appended to the data packet, or 
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otherwise forwarding the data packet to a next distributing station. 

90. The resihent closed communication network according to claim 89, wherein the 
selecting means considers optimization factors including an available traffic volume, an actual 
distance value, and a preference value. 
5 91. The resihent closed communication network according to claim 89, wherein the 

selecting means includes: 

means for calculating available traffic volume for each of the functioning routes; 

means for maintaining a distance table containing information necessary to determine an 
actual distance value for each of the functioning routes; 
10 means for finding optimal route candidates, which are routes with the smallest actual 

distance value among the functioning routes with a positive available traffic volume if at least 
one of the functioning routes has a positive available traffic volume, routes with the smallest 
available traffic volume if the largest available traffic volume among the functioning routes is 
zero, or routes with the largest available traffic volume if all the functioning routes have a 
15 negative available traffic volume; and 

means for choosing an optimal route from the optimal route candidates. 

92. The resilient closed communication network according to claim 91, wherein the 
choosing means uses a preference value to select an optimal route when there are at least two 
optimal route candidates. 

20 93. The resihent closed communication network according to claim 92, wherein each 

distributing station further includes means for prioritizing an order of sending the data packet 
when the optimal routes has a negative available traffic volume. 

48 

l-WA/ 1349263.1 



94. The resilient closed communication network according to claim 93, wherein the 
prioritizing means uses information contained in a transport layer of the data packet using an OSI 
model. 

95. The resilient closed communication network according to claim 91, wherein each 
5 distributing station further includes means for prioritizing an order of sending the data packet 

when the optimal routes has a negative available traffic volume. 

96. The resilient closed commimication network according to claim 95, wherein the 
prioritizing means uses information contained in a transport layer of the data packet using an OSI 
model. 

10 97. The resilient closed communication network according to claim 91, wherein no 

segment of the first communication ring is used as a dedicated protection segment. 

98. The resilient closed communication network according to claim 91, wherein the 
first commimication ring is made of fiber optic cables. 

99. The resilient closed communication network according to claim 89, wherein no 
15 segment of the first communication ring is used as a dedicated protection segment. 

100. The resilient closed communication network according to claim 89, wherein the 
first communication ring is made of fiber optic cables. 
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101. A resilient closed communication network comprising: 
a first communication ring; and 

at least two distributing stations interconnected by the first communication ring, each 
distributing station including: 
5 a router capable of receiving a data packet from an external network connected to the 

distributing station and of forwarding the data packet to the external network connected to the 
distributing station; and 

a packet distributor comprising: 

means for receiving a data packet from the router in the same distributing station or from 
10 another distributing station in the resilient closed communication network; 

means for identifying a network address of a destination router in the destination 
distributing station for the data packet received from the router in the same distributing station; 

means for determining an identification number of a destination packet distributor in the 
destination distributing station; 
15 means for appending the identification number of the destination packet distributor to the 

data packet received from the router in the same distributing station; 

means for determining ftmctioning routes to the destination distributing station within the 
resiUent closed communication network; 

means for selecting an optimal route among the fimctioning routes; 
20 means for appending a route segment data for the optimal route to the data packet 

received from the router in the same distributing station; and 

means for forwarding the data packet to the router in the same distributing station after 
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removing the identification number and the route segment data from the data packet if the 
identification number of the distributing station is the same as the identification number 
appended to the data packet, or otherwise forwarding to a next distributing station using a route 
segment specified in the route segment data after updating the route segment data. 
5 102. The resihent closed communication network according to claim 101, wherein the 

selecting means considers optimization factors including an available traffic volume, an actual 
distance value, and a preference value. 

103. The resilient closed conmiunication network according to claim 101, wherein the 
selecting means includes; 
10 means for calculating available traffic volume for each of the fimctioning routes; 

means for maintaining a distance table containing information necessary to determine an 
actual distance value for each of the fimctioning routes; 

means for finding optimal route candidates, which are routes with the smallest actual 
distance value among the fimctioning routes with a positive available traffic volume if at least 
15 one of the fimctioning routes has a positive available traffic volume, routes with the smallest 
available traffic volume if the largest available traffic volume among the fimctioning routes is 
zero, or routes with the largest available traffic volume if all the fimctioning routes have a 
negative available traffic volume; and 

means for choosing an optimal route from the optimal route candidates. 
20 104. The resihent closed communication network according to claim 103, wherein the 

choosing means uses a preference value to select an optimal route when there are at least two 
optimal route candidates. 
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105. The resilient closed communication network according to claim 104, wherein 
each distributing station further includes means for prioritizing an order of sending the data 
packet when the optimal routes has a negative available traffic volume. 

106. The resilient closed communication network according to claim 105, wherein the 
5 prioritizing means uses information contained in a transport layer of the data packet using an OS! 

model. 

107. The resihent closed communication network according to claim 103, wherein 
each distributing station fiirther includes means for prioritizing an order of sending the data 
packet when the optimal routes has a negative available traffic volume. 

10 1 08. The resilient closed communication network according to claim 1 07, wherein the 

prioritizing means uses information contained in a transport layer of the data packet using an OSI 
model. 

109. The resihent closed communication network accordmg to claim 103, wherein no 
segment of the first communication ring is used as a dedicated protection segment. 
15 110. The resihent closed communication network according to claim 1 03 , wherein the 

first communication ring is made of fiber optic cables. 

111. The resihent closed communication network according to claim 101, wherein no 
segment of the first communication ring is used as a dedicated protection segment. 

112. The resilient closed communication network according to claim 101, wherein the 
20 furst communication ring is made of fiber optic cables. 
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ABSTRACT OF THE DTSCT.OSIJRE 

A method and system for operation of a resilient closed communication network without 
a dedicated protection network segment. The method uses a resilient closed communication 
network with at least one communication ring. The method includes the steps of receiving a data 
5 packet from a first extemal network at a first distributing station connected to the network, 
identifying a second distributing station connected to the network from which the data packet is 
to be forwarded to a second extemal network, and determining fixnctioning routes from the first 
distributing station to the second distributing station. The method also includes the steps of 
selecting an optimal route among the functioning routes and sending the data packet from the 

10 first distributing station to the second distributing station using the optimal route. The system 
includes a first communication ring and at least two distributing stations interconnected by the 
first communication ring. The distributing station includes means for receiving a data packet 
from an extemal network or from another distributing station, means for identifying a destination 
distributing station for the data packet. It further includes means for appending the identification 

15 number for the destination distributing station to the data packet, means for determining 

functioning routes to the destination distributing station, and means for selecting an optimal route 
among the functioning routes. Finally, it also includes means for forwarding the data packet to 
the extemal network after removing the identification number from the data packet if the 
identification number of the distributing station is the same as the identification number 

20 appended to the data packet, or otherwise to a next distributing station based on the optimal 
route. 
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that such willfiiJ fsdse statements may jeopardi2e the validity of the application or any patent i&sumg dicreon_ 
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